Web Survey Bibliography
Title Tracking the Representativeness of an Online Panel Over Time
Author Klausch, L. T.; Scherpenzeel, A.
Year 2016
Access date 01.06.2016
Abstract
One of the greatest threats to the accuracy of estimates from panel data is the occurrence of attrition of participants over the panel lifetime. Fortunately, panel recruitment interviews often provide rich sources of data that allow identifying the type of background characteristics affected most seriously by attrition. However, in practice the degree of attrition is seldom studied on these rich data sets, possibly because it is difficult to synthesize the degree of attrition across many auxiliary covariates. In this study, we address this shortcoming while studying attrition in the Dutch Liss online panel using the rich set of auxiliary variables available from the panel recruitment interviews. We estimated panel representativeness for each month of seven years of panel lifetime (2008-2015) using so-called representativeness (R-) indicators. The favorable feature of R-indicators is that they allow quantifying the degree of selectivity in a sample at a given point in time based on the information encoded in theauxiliary data. In doing so, we could include nearly forty variables in estimating representativeness,including respondents’ health, economic status, personality, political attitudes, and survey attitudes, besides standard socio-demographics. The time-series of R-indicators that resulted from this project offers a unique view into the evolvement of panel representativeness and attrition. We found that attrition occurred in the Liss panel in two stages. First, there was an onset loss in representatives that occurred already at the first panel wave. Second, representativeness decreased across two and a half years of panel lifetime and subsequently stabilized. In our presentation, we show how the general losscan be split up into the contributions of the variable groups. We also evaluate the impact that a stratified and a random refreshment sample had on panel representativeness.
Access/Direct link Conference Homepage (abstract)
Year of publication2016
Bibliographic typeConferences, workshops, tutorials, presentations
Web survey bibliography - Scherpenzeel, A. (19)
- Tracking the Representativeness of an Online Panel Over Time ; 2016; Klausch, L. T.; Scherpenzeel, A.
- Informing panel members about study results; 2014; Scherpenzeel, A., Toepoel, V.
- Improving Survey Methods: Lessons from Recent Research; 2014; Engel, U., Jann, B., Lynn, P., Scherpenzeel, A., Sturgis, P.
- Random versus Systematic Error in a Mixed Mode Online-Telephone Survey; 2013; Hox, J., Scherpenzeel, A., Boeve, A., Boeve, A., de Leeuw, E. D.
- Mobility and Smartphones: a pilot study of travel data collection among experienced and inexperienced...; 2013; Douhou, S., Scherpenzeel, A.
- Does It Pay Off to Include Non-Internet Households in an Internet Panel? ; 2013; Leenheer, J., Scherpenzeel, A.
- Timing of Nonparticipation in an Online Panel: The effect of incentive strategies; 2013; Douhou, S., Scherpenzeel, A.
- Experiences from a probability-based Internet panel: Sample, recruitment and participation; 2013; Scherpenzeel, A.
- Recruiting A Probability Sample For An Online Panel: Effects Of Contact Mode, Incentives, And Information...; 2012; Scherpenzeel, A., Toepoel, V.
- Time use data collection using Smartphones: Results of a pilot study among experienced and inexperienced...; 2012; Scherpenzeel, A., Sonck, N., Fernee, H., Morren, Me.
- True Longitudinal and Probability-Based Internet Panels: Evidence from the Netherlands; 2011; Das, M., Scherpenzeel, A.
- Can biomarkers be collected in an Internet survey? A pilot study in the LISS panel; 2011; Avendano, M., Mackenbach, J., Scherpenzeel, A.
- Mode Effect or Question Wording? Measurement Error in Mixed Mode Surveys; 2011; de Leeuw, E. D., Hox, J., Scherpenzeel, A.
- Building an Online Immigrant Panel: Response and Representativity; 2011; Scherpenzeel, A.
- Start of the LISS panel: Sample and recruitment of a probability-based Internet panel ; 2009; Scherpenzeel, A.
- Effects of data collection technique on the quality of data: A MTMM study of CATI, CAPI and Online interviews...; 2009; Scherpenzeel, A.
- An online panel as a platform for multi-disciplinary research; 2008; Scherpenzeel, A.
- Online interviews and data quality: A multitrait-multimethod study ; 2008; Scherpenzeel, A.
- Pilot study to recruite a sample for an online panel: Effects of contact mode, incentives and information...; 2007; Scherpenzeel, A.